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Abstract 

We prove several existence and non existence results of solitary waves 
for a class of nonlinear pseudo-relativistic Hartree equations with gen- 
eral nonlinearities. We use variational methods and some new variational 
identities involving the half Laplacian. 
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1 Introduction, motivations and main result 

In [19] . Frohlich e Lenzmann studied the Schrodinger equation with a Hartree 
nonlinearity 

ii/j t = y/-A + m 2 ip - ( i * |V>| 2 | ip inR 3 (1.1) 
VM / 

as a description of pseudorelativistic boson stars (see [IT] for the rigorous deriva- 
tion of the model). Here ip(t,x) is a complex-valued wave field (a one-particle 
wave function), the symbol * stands for the usual convolution in R 3 , and l/|x| is 
the Newtonian gravitational potential (after setting all physical constants equal 
to 1). The operator \J — A + m 2 , which coincides with the so-called half Lapla- 
cian (—A) 1 / 2 when m = 0, describes the kinetic and rest energy of a relativistic 
particle of mass m > C0, and can be defined in several ways. For example, we 
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can associate to V~A + to 2 its symbol \Jk 2 + to 2 in the following way: for any 
/ e H l (M N ) with Fourier transform Tf, we define 



J"(V-A + m 2 /)(fc) = yj\k\ 2 +m 2 Ff{k), 

which is actually well defined in i? 1/ ' 2 (R Ar ), see [20] for a complete description 
of this method. 

We will follow another approach to define y/—A + to 2 , extending to the 
whole Euclidean space the "Dirichlet to Neumann" procedure (see, for example, 
0), which consists in realizing the nonlocal operator \J — A + to 2 in R 3 through 
a local problem in Ri = R 3 x (0, oo). In view of our general statements, we will 
present this procedure in every dimension N > 2: for any function u € J?*(R ) 
there exists a unique function u 6 ^(R^ +1 ) such that 

J - Av + m 2 v = in R^ +1 

\v(x,Q) =u(x) on <9R^ +1 = R w x {0} ~ R w , 

i.e. v is the generalized harmonic extension of u in R, +1 . Here, and in the 
following, we shall denote by a; a generic point of R^. Now, consider the operator 
T defined as 

T U (x) = --^(x,0). (1.3) 

OXN+l 

It is readily seen that the system 




in R? +1 



{x, 0) = Tu(x) on dR^ +1 = R N x {0} ~ ™ N 



admits the unique solution w(x,y) = — ( x i y)i an d t nus by (ll.2p we im- 
mediately have 

T{Tu)(x) = -j^—(x, 0) = j^j—ix, 0) = (-Av + m 2 v)(x, 0). 

0X N+ i ox N+l 

In conclusion, T 2 = — A + to 2 , i.e the operator T mapping the Dirichlet datum u 
to the Neumann datum — - (■, 0) is a square root of the generalized Laplacian 

-A + to 2 in R£ +1 . 

Going back to such an equation does not take into account the presence 

of outer influences or mutual interactions among particles, so that it seems 
natural to include the presence of a potential, considering 



ixj} t = V-A + to 2 i\) - \{W * IV'I 2 )^ + F'W inR N , (1.4) 

where A £ R and F : R — > R is a C 1 potential having some good invariant 
(common in Abelian Gauge Theories, see [6], [23], [24]): typically, one requires 
some conditions of the form F(e l8 u) — F(u) and F'{e l9 u) — e l6 F'(u) for any 
function u and any £ R, which is obviously satisfied by linear combinations 
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of power-like nonlinearities. Finally, W is a radially symmetric weight function 
which generalizes in M. N the Newtonian potential l/\x\ in M 3 . In particular, we 
will also assume that W can be decomposed as sum of a bounded function plus 
another function having suitable integrability (see Theorem 11.11 for the precise 
assumptions). 

We are interested in solitary wave solutions of (jl.4[) of the form 

ip(x,t) = e~ iult u(x), where oj e K and u : 1* -> R; 

thus, since the Fourier transform acts only on the x-variables, it is readily seen 
that u solves 

y/-A + m 2 u -Lju- X(W * u 2 )u + F'(u) = in R N . 

Actually, there is no reason to discard an x-dcpcndcnce in the potential F — 
F(x, s), so that we will actually consider the following nonlinear Hartree equa- 
tion with potential: 

y/-A + m 2 u -urn- X(W * u 2 )u + F s (x, u) = in R N . (1.5) 

Let us remark that in R 3 with W(x) = l/\x\ such an equation is equivalent to 
the following system of pseudorelativistic Schrodinger-Poisson type: 

V— Am + m 2 u — urn — \ud> + F^(x, u) = in R 3 

v ' (1.6) 

-Acj) = 4ttu 2 in R 3 , 

where the second equation represents the repulsive character of the Coulomb 
force (the attractive case is described by the equation A<j> = Attu 2 , see [H]). 
We also note that this very last system is the pseudorelativistic version of the 
classical Schrodinger-Poisson system, or Hartree-Fock equation, which has been 
object of a large interest in the last decade, also for its applications in modelling 
molecules and crystals, and we only quote [3], [4], [10], pj], [12], [13], [15], [16], 
[2"2] . PS] . P5] and the papers cited therein as a brief references list. 

When N = 3, the case A = 1 and F = was studied in [21] (for existence of 
spherically symmetric solutions) , in [T5] (for stability of standing wave solutions 
of (II. ip ). in [TH] (for instability of standing wave solutions of (jl.ll) when m = 0). 

The fact that the natural domain for the governing operator in (|1.5[) is 
iJ 1 / 2 (M Ar ), forces to decrease the range of natural exponents in the nonlineari- 
ties which could appear in the equation, according to the Sobolev Embedding 
Theorem; more precisely, if N = 3, the critical exponent is 3; hence, all sub- 
critical superlinearities in the equation may have a growth between 1 and 2. In 
fact, equation (|1.5|) was considered in [14] when A = 1, uj < m and m > 0, with 

F(x,s)=F(s) = - l -L, pe^j^-jj. (1.7) 

Let us remark that the prototype potential defined in (jl.7p is not positive, 
while for physical reasons a potential suitable to model physical phenomena 
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should be nonnegative: indeed, the fact that F is nonnegative implies that the 
potential energy density of a solution of equation (|1.5p has more nonnegative 
contributions, as one can see from the expression of the Lagrangian in equation 
(12.24|) below. Another reason to consider positive potential is that, if we consider 
the classical autonomous electrostatic case — Au+F'(u) = 0, calling "rest mass" 
of the particle u the quantity 

F(u) dx 

(see [7]), the fact that F is positive implies that the systems under consideration 
has - a priori - positive mass, which is, of course, relevant from a physical 
viewpoint. 

Therefore, in this paper, as far as existence is concerned, we shall consider 
equation (|1.5j) under the assumptions that F is nonnegative and m > 0. 

Using the approach with the operator T introduced in (|1.3| . we rewrite 
equation (|1.5j) as the following system: 

j-Av + m 2 v = mK^ +1 , 

i -q§^ = ljv + \(W * v 2 )v ~ F s (x,v) on<9M+ +1 = R N x {0} ~ R N . 

(1;8) 

As usual, for physical reasons, we look for solutions having finite energy, i.e. 
v £ i/ 1 (M" +1 ), H 1 (R 1 ^ +1 ) being the usual Sobolev space endowed with the 
scalar product 

(v,w)hi := / (Dv-Dw + m 2 vw)dxdxN+i 
and norm ||u|| = (/ \Dv\ 2 + m 2 f v 2 ) 1 ^ 2 . 

Definition 1. A function v € ff 1 (M+ +1 ) is said to be a (weak) solution of 
problem (TO)) iff for every w € H 1 ^^ 1 ) there holds 



N + l 
+ 



(Dv ■ Dw + m 2 vw) dxdxN+i — j [ojv + \(W * v 2 )v — F s (x, vj\ w dx. 

(1.9) 

Remark 1.1. We remark that, whenever a solution v € i? 1 (R^ +1 ) of (|1.8j) is 

given, then 

F s (x,v)wdx e K for all w e iJ 1 (M+ +1 ) 



'I* 

without assuming any growth condition on F. 

In this paper we are concerned with problem (|1.8[) in presence of a generally 
nontrivial potential F, always neglected in the previous papers, except for [T4"] ; 
hence, in order to cover the trivial case F = 0, for the main existence result 
(see Theorem I Lip we shall use the following general superlinear and subcritical 
assumptions, which, however, can be relaxed for the other existence and for the 
non existence results, see Propositions 1 1 . 1 [ 1 1 . 21 and 11.31 and Theorem II .31 below: 
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Fx) F : R N x M — > [0, oo) is such that the derivative F s : R N x R — > R is a 
Caratheodory function, F(x,s) — F(\x\,s) for a.e. x G M. N and for every 
s G R, and F(x,0) = F s (x,0) = for a.e. x G 1 N ; 

F 2 ) 3 Ci, C 2 > and 2< £ <p < 2N/{N - 1) such that 

\F s (x, s)| < Cilsl^ 1 + C^N^ 1 for a.e. lei" and every s G R; 

-F3) 3fc > 2 such that < sF s (x,s) < kF(x,s) for a.e. x G R w and every 

Remark 1.2. Condition F3) is a kind of reversed Ambrosetti-Rabinowitz con- 
dition, already used, for instance, in [5], [24] and [25] . 

Remark 1.3. As it will be clear from the existence proof, the requirement that 
F depends radially on the space variable is a technical assumption which lets 
us reduce the problem to a radial setting and use some compactness properties 
in the associated Sobolev space. 

Remark 1.4. From F\) we immediately get that F has an absolute minimum 
point for s = and for a.e. x G R , so that problem (|1.8[) always admits the 
trivial solution u = 0. Moreover, by direct integration of F2) we get 

0<F(x,s)<^\s\ e + ^\ S \P (1.10) 
I p 

for every s € R and a.e. a; € R N , so that the potential F is superquadratic 
at and subcritical at infinity, as in the case of (|1.7[) . For this reason, in F3) 
we exclude the case k < 2, since by simple calculations we would get F = 0, 
already considered in the related literature. 

Remark 1.5. Our assumptions include the case F = 0, but even the more 
intriguing cases in which F(x, s) — for a; belonging to a proper subset of M. N - 
a ball (so that the potential F is active only in an exterior domain), an annulus, 
or for some values of s - for instance when s is large or small. All these 
situations are completely new, and, to our best knowledge, this paper is the first 
one to consider (|1.8|) with a potential, even possibly vanishing somewhere. In 
particular, we remark that no control from below is assumed on the potential F, 
as done, for instance, in [6] for a Klein-Gordon-Maxwell system with positive 
potential. 

Since u — is a solution of problem (|1.8[) . we are interested in nontrivial 
solutions. But, before giving our first existence result, we make precise the 
assumptions on the weight potential W , which will be assumed from now on: 

W): W : R N -> [0,oo) is such that W(x) = W(\x\), W = W x + W 2 , where 
Wi € L r {R N ) for some r e (AT/2, 00), and W 2 G ^(R"). 
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Remark 1.6. If N = 3 we can take the Newton potential W(x) — l/|x|, which 
is bounded at infinity and in L r near the origin for r < N, so that all our 
results cover the physical problem (|1.6[) . However, if we require that solutions 
have a constant L 2 norm equal to M (like in [2]), it turns out that the Newton 
potential is critical, in the sense that if W(x) — l/\x\, then a radial, real-valued, 
nonnegative ground state solitary wave in iJ 1 / 2 (M 3 ) does exist only if M < M c , 
M c being the Chandrasekhar limit mass for boson stars modelled by (and 
in such a case the solution is found via a minimization process). Therefore, not 
fixing the L 2 norm of solutions leaves us more freedom in the quest of solutions. 

Moreover, another classical potential we can treat when N — 3 is any Yukawa 
type two body interaction, that is W(x) = e~^ x '/\x\, fJ, > 0. 

Remark 1.7. In contrast to [14] and to the behaviour of the Newton or Yukava 
potential, we do not require that W(x) — > as |x| — > oo, so that we are allowed 
to consider a wider class of kernels. 

We are ready for our main existence result. 

Theorem 1.1. Assume that F satisfies Fi), F2) and F3) with k < 4 and that 
W satisfies W). Then for any A > and uj < m there exists a nontrivial 
solution v G ff 1 (R^ +1 ) of problem (11.81) which is radially symmetric in the first 
N variables. If in addition, F(x,s) > F(x, \s\) for a.e. x € R N and all s E R, 

then v is strictly positive in R^ +1 . 

The assumption A > in Theorem 1 1.1 1 is not restrictive. Indeed, just under 
a more general version of assumption F%) above, problem (|1.8p admits only the 
trivial solution when A < 0, independently of any possible symmetry: 

Proposition 1.1. Suppose that F s (x,s)s > for a.e. x £ M. N and all s 6 R ; 
and let v g iJ x (R^ +1 ) be a solution of problem (|1.8[) with A < and lu < m. 
Then v — 0. 

For the more general non existence results in R 3 we assume that F satisfies 
a weaker form of -Fi), i.e. we require that F is independent of the x-variable 
and needs not be nonnegative: 

Fi)' F : R 3 -> R is of class C 1 with F(0) = F'(0) = 0. 

The non existence results we shall prove are consequences of the following vari- 
ational identity involving the generalized half Laplacian, which we consider of 
independent interest : 

Theorem 1.2. Assume Fx)'; if v £ 7J 1 / 2 (R 3 ) is a solution of (|1.6[) such that 




then 




(1.11) 
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As aforesaid, by exploiting (11.111) we are able to prove 
Theorem 1.3. Assume F\)' ; let v £ H 1 ^ 2 (R 3 ) be a solution of (|1.6[) such that 



If 



or 



or 



or 



F(v) dx £ R. 

ui < 0, A < and F'(s)s < 3F(s) 
OJ < 0, A < and 3F(s) < 2F'(s)s 



A<0,w£ 



0, m 



and F(s) > 



Vs e 1 
Vs e I 
Vs e 



(1.12) 
(1.13) 
(1.14) 
(1.15) 



A > 0, lj £ (0, m) and < F'(s)s < 2F(s) Vs £ R, 
t/ien = 0. 

As a straightforward application, we have the following 
Corollary 1.1. If v £ H 1 / 2 (R 3 ) D L p (E. 3 ) solves (II]), then v = provided that 

^ < 0, A < 0, and p > 0, or 



F( S ) 



and < A < 0, oj £ 



0, m 



and p > 0, or 



A > 0, uj £ (0,m),p£ (0,2] 



• F(s) = w < 0, A < andp £ (0, §] U [3,oo). 

Remark 1.8. In condition ()1.14j) . contrary to the assumptions of Proposition 
11.11 no sign assumption is made on F' . 

The Corollary above shows that the existence result proved in P3] for A > 0, 
uj < m and F(s) — — \s\ p /p with 2 < p < 2N/(N— 1) is somehow optimal, since 
in the supercritical case only the trivial solution shows up, independently of any 
possible symmetry. 

On the other hand, such a Corollary also guarantees that our requirement 
of working with a superquadratic F when A > and uj < m is not only a 
technical one, since if F is subquadratic or quadratic (p — 2), then only the 
trivial solution can exist. 

Actually, Theorem ll.3l is a special case of a more general result, which is the 
following: 

Theorem 1.4. Assume F\)' ; let v £ H 1 / 2 (R 3 ) be a solution of (L6j) such that 

/ F(v) dx £ R. 
Jr 3 



If 



u) < 0, A < and 3 p < 1 s.t. pF'(s)s < 3F{s) V s £ 



(1.16) 
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or 



oj < 0, A < and3p > 2 s.t. 3F(s) < pF'(s)s Vs e M, 



(1.17) 



or 



A < 0, 3p > 2 s.t we 0,2m 



- v /(p-l)(p-2) 



and 3F(s) < pF'(s)s VseR, 

(1.18) 



2p-3 



i/ien w = 0. 

We remark that the conditions in (|1.16|) and (|1.17[) are not consequences of 
the corresponding ones in (|1.12j) and (|1.13|) . since no assumptions on the sign 
of F or F' is ever made. 

We conclude our list of results with two existence statements which can 
be proved without condition F 3 ), but only assuming the positivity and the 
subcriticality of F; in this case, A appears as a Lagrange multiplier: 

Proposition 1.2. Assume F\), F%) and suppose that uj < m. Then there 
exists A £ R such that the associated problem (|1.8|) admits a nontrivial solution 
u £ iF;(K+ +1 ). If in addition, 2F(x,s) < F s (x,s)s for all s £ R and a.e. 
x £ R N , then A > 0. 

Proposition 1.3. Assume F\), F2) and suppose that lj < m. Moreover, sup- 
pose that F(x, s) — F{x, —s) for all s £ M. and a.e x £ M. N . Then there exists a 
sequence (A n )„ £ R such that the associated problems (|1.8|) with A = A„ admit 
a couple of nontrivial solutions ±ti„ £ H^iM.^ 1 ). If in addition, 2F(x,s) < 
F s (x, s)s for all s £ R and a.e. x £ M. N , then A„ > for any neN. 

From a physical viewpoint, positive solutions are the most interesting ones, 
and in fact we can prove 

Proposition 1.4. If A < or F(x,s) > F(x,\s\) for a.e. x £ R N and all 
s £ R, the solution found by Proposition \\.2\ is strictly positive in R^ +1 . 

Remark 1.9. If only Fi) and F2) are in force, the assumption A < does not 
contradict Proposition II .11 above. 

2 Proofs of the existence theorems 

Let us start making precise some notations: 



Let us recall that any v £ iJ 1 (R^ +1 ), N > 2, admits trace (still denoted by v 
for simplicity) on 9R^ +1 = R w x {0} ~ R N , and that the following embeddings 
hold true (see [U Theorems 7.58 and 7.57]): 



(x,x N +i) 



a point of R+ +1 = R N x (0, 00), 

the norm of v in iF(IR^ +1 ), 

the norm of v in L^(R^ +1 ), 

the norm of (the trace of) v in L q (R N ). 



v 
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where x = 1 - ^ + f e [0, 1) and q < <r < Nq/(N - X q)- Let us note that 
q = 2N/(N-l + 2x) > 2 for any x < 1/2 and that Nq/(N~xq) =2N/(N-l) 
for any x\ hi particular 

H l (^l +1 ) ^ L 2 (R N ) and H 1 ^ 1 ) ^ L 2N ^ N -^(R N ). 

In addition, 

< tt for any x > 0, 



and 



iV + 2 N - xi 
AN 



>q 



N + 2 

as soon as x > 1 — iV/4. In particular, by interpolation, we get that any 
v G tf x (R^ +1 ) is such that u 2 G (L 2 * (t^))' = L^TU(¥ N ^ 
Moreover, if v G C° 



D ,+ +1 ), we have 



|u(a:,0)|9da; 



rf.r 



o 5x 



N+l 



\v(x,x N+ x)\ 9 dx N+ i 
dv 



= -q 

and by the Holder inequality 



\v{x,x N+1 )\ q 2 v(x,x N+1 )- (x,x N+ i)dxdx N+ i, 

N + i OXn+1 



By interpolation, the Sobolev inequality and by density, we get that 

\v(x,0)\ q < c q \\v\\ for any v G (2.20) 

provided that 2 < 2q - 2 < 2(N + 1)/(N - 1), that is 2 < q < 2N/(N - 1). 
Applying the Young inequality to (|2.19[) we also get 



\v(x, 0)|| < ^- / |«| a »- 2 dxda! JV+ i + - / 







dv 


e J 




dx N+ i 



dxdx 



N+l 



(2.21) 



for any e > 0, and in particular, when q = 2, we have 

2 



|v(x,0)|a < e / |w| 2 dxda;Ar + i + 



1 



N+l 
+ 





dv 




OXN+1 



dxdxN+i for any e > 0, 
(2.22) 



Now, write 



(W *v 2 )v 2 (x)dx = / (VFi *u 2 )w 2 (x)dx+ / (W 2 * v 2 )?; 2 (a;) c&r. 



By Holder's inequality, we can estimate the right hand side of the previous 
inequality by 



\v\t\Wi*v 2 \ q , + \W 2 Uv\i 
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Now apply Young's inequality for convolutions choosing q so that 1/q' = 1/r + 
1/q— 1, that is q — 2r/(2r — 1), estimating with 

l«&|Wi|r|A + |W 2 UM$; 

note that, since r > N/2, we have 1 < q < N/N—l. Finally, by the interpolation 
and the Sobolev inequalities, we get that there exists C = C(W) > such that 

(W *v 2 )v 2 (x)dx < C\\v\\ 4 for any v € H 1 (R I ^ +1 ). (2.23) 

In view of the previous remarks, by exploiting the radial symmetry of W, 
the proof of the following result is straightforward: 

Proposition 2.1. A function v € iJ x (R^ +1 ) is a solution of system (|1.8j) iff v 

is a critical point of the C 1 functional J : ff 1 (R+ +1 ) — > K defined as 



J ( v ) =o / {\Dv\ 2 +m 2 v 2 )dxdx N+1 



JV + l 



* v 2 )v 2 



F(x,v) 



(2.24) 



dx. 



Due to the lack of compactness of the rotation group in K.^, we will look 
for critical points of J constrained on the space of functions which are radially 
symmetric in the first ./V variables, that is 

i^(M+ +1 ) = {v € H 1 (M^ +1 ) : v(Mx,x N+1 ) = v(x,x N+1 ) for any M e 0(N)\; 

here O(N) denotes the orthogonal group in R w . Since the problem under con- 
sideration is invariant by rotation around the iEAr + i-axis, if v g H^(R^ +1 ) is a 
critical point of J constrained on i/^(R^ +1 ), then v is also a critical point of J 
on the whole of ii" 1 (R+ +1 ) by the Principle of Symmetric Criticality of Palais, 
see [26]. Hence, we will look for critical points of J constrained on i?^(IR^ +1 ). 
In particular, we want to show that under the assumptions of Theorem 1 1.11 the 
functional J constrained on i?^(IR^ +1 ) satisfies the hypothesis of the Mountain 
Pass Theorem (see [2]). 

First, we prove that J\h 1 (m n+1 ) nas a strict minimum point in v = 0. Indeed, 
taking e = m in (|2.22j) , since F > 0, using (|2.23[) . we have 

J(v)>(l-£-) I \Dv\ 2 dxdx N+1 +(^-^) I v 2 dxdy-C\\vr 

for any v £ H^(R^ +1 ), and the claim follows, since cj < m 

1% 



Moreover, if v € if*(R+ +1 ) is such that v(x,0) ^ 0, taken t > we have 



J(tv) = — / (|-Dw| 2 + m 2 v 2 ) dxdx N+1 

^ 2 + Ai 4 (wWy-F(:c,to) 
< At 2 - Bt A + Ct l + Dt p 



dx 
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by (jl.101) . where A, B, C, D are positive constants. Now, if p < 4, we have that 
At 2 — Bt A + Ct e + Dt p -> — oo as t — > oo. Note that the requirement p < 4 is 
automatically satisfied, since p < -J^r < 4 for every N > 2. 
We also need 

Lemma 2.1. J satisfies the Palais-Smale condition on H^(R^ +1 ), i.e., every 
sequence (v n ) n in H^(R^ +1 ) such that (J(v n )) n is bounded and J'(u n ) — > in 
(H^(R^ +1 )Y as n — ¥ oo, admits a convergent subsequent. 

Proof. Let (v n ) n in i/^(R^ +1 ) be as in the statement above. We first prove 
that (v n ) n is bounded. Indeed, by assumption, there exist A, B > such that 

4J(v n )- J' («„)(«„) <A + B\\v n \\. 

On the other hand, 

4J(u„) - J'(v n )(v n ) = / [l-Dvnl 2 + rn 2 v 2 ] dxdx N+1 - co / v 2 dx 
+ / \4F(x,v n ) - F s (x,v n )v n \ dx 

> fl ) / \Dv n \ 2 dxdxN+i + m(m — u>) / v 2 dxdx 

by (|2.22j) applied again with e = m and by F 3 ). In conclusion, there exist C > 
such that 

c|K|| 2 < A + fl|K||, 

and thus 

(u„)„ is bounded in i/i(M^ +1 ), (2.25) 

as claimed, and so we can assume that v n — w in iJ^(IR^ +1 ). 

By (|2.20[) , (denoting as usual the trace of a function by the function itself) 

we get that (v n ) n is bounded also in L q (R N ) for any q G 2, , so that we 

may assume, without loss of generality, that v n — 1 u in L 9 (R Ar ). However, by 

the compact embedding of H^ 2 (R N ) in i^M^) for any q G (2, , see [30], 

we actually have that 

v n -J- v in L 9 (M Ar ) for any g G (2, ^\ . (2.26) 

Up to subsequence, we can also assume that v n — ¥ v a.e. in R^ +1 . 

We will now show that v n — > v in H^(M.^_ +1 ). First, F s (x,v n ) — > F s (x,v) 
a.e., since F s is a Caratheodory function by i<i), and by F2) 

\F S (X, V n ){v n -V)\< ClKI^K - v\ + C* 2 |w„| p ->„ - v\. 

For instance, 

/ KI^K - v \ dx < Ivnff^Vn - v\ e -> asn^oo 



Af+l 
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by (|2.26l) and (I2.25[) . Analogously, we have 

\F s (x,v)(v n -v)\ < CiM^K - v\ + C 2 \v\ p - 1 \v n -v\ -> asrt^oo, 
and so Lebesgue's Theorem gives 



[F s (x, v n ) — F s (x, v)](v n — v) dx — > as n — > oo. 
Moreover, for any g 6 ^2, jl^j^ , so that q' G ($p£> 2^ j we S et 



(2.27) 



/ (W*t£)u n (u„ -u)da 
< k - «l« ( / kO*)K ( / W(a: - z)t4(z)<faA 



W (2.28) 



First, Minkowski's inequality implies that for any p G [1, oo] there holds 

|W * vX < \Wi * vl\ P + \W 2 * vX- (2.29) 

Now, by Holder's inequality and Young's inequality for convolutions, for any 
t G (1, oo) we have 



\Vn\ q [ Wl(x- Z)vi{x)dx dz < \v n \*\Wl * <|« , 



"" V (2.30) 



where 1 + 77-7 = - + -. Choosing t such that o't = 2a, that is cr = „, , 3q r — n . 

t'q' r a & ^ ' 2(q'r-\-r—q') ■ 

we finally have 
Requiring 2a € 



9 2jv 

z > iV-l 



implies 
2r 



(2.31) 



r + 2 



< a' < 



2Nr 



rN - 3r + 27V 



Since r > iV/2, we have 
27V 2r 



< 



n , 2iV 
< 2 and — < 



27V r 



< 



2iV 



AT + 1 rN - 3r + 2iV iV - 3 



iV + 4 r + 2 



finally have the nontrivial possibility g' G ^j^ji 2 J , that is g € (^2, j^zjj , with 
obvious meaning if N < 3. 

In this way (|2.28j) . (|2.3ip and (|2.25l) imply the existence of C > such that 



Wi(x - z)<(:r)cfc < C for every n G N. (2.32) 
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On the other hand, proceeding as above, we have 

\v n (W 2 *vl)\ q , < \v n \ q , t \v n \ 2 a \W 2 \ c 



where t can be chosen so that q't = 2<j £ 



) 2N 

J ' JV-l 



obtaining, as above, 



\Vn(W 2 *vl)\ ql < \v n \ qH \v n \ 2 2(r \W2\oo < C 



for some C > and all n E N. 

In conclusion, from (|2.29[) we get 



[W * vl)v n (v n - v)dx 



< C\v n - v\ Ci 



(2.33) 



(2.34) 



for some C > and all n e N. 

Reasoning as above, one can also prove that 



(W * f 2 ) v(v n — v)dx 



< C\V n - V\g 



(2.35) 



for some C > and all n 6 N. 

We also need to prove that v is a critical point of J on i^(R^ +1 ). To this 
purpose, start from J'(v n )(w) — » as n — !• oo for every u; e i/^(R^ +1 ), i.e. 

( v u,w)h 1 ~ / [wn„w + XW * v 2 t w — F s (x, v n )w] dx — > 0. 
Thus, by the weak convergence of v n to t>, it is enough to prove that 
lim / [\(W*v 2 )v n w — F s (x,v n )w] dx = / [\(W * v 2 )vw — F s (x, v)w] dx. 

n^oc J RN ' J RN 

First, by F 2 ) we have 

F s (x,v n )wdx < / \Cx\vnf- 1 + C 2 \ v n \ p 1 ] \w\ dx (by Holder's inequality) 

< Ci\v n \$- ^wU + CM^lwlp -> dl^-VU + Cakir 1 ^^. 
Hence, by the Generalized Dominated Convergence Theorem 



Then. 



lim / F s (x,v n )wdx— / F s (x,v)wdx 



(W * V 2 )v n W — (W * J) 2 )TO 



dx 



(W * v 2 ) (v n — v)w dx + (W * (v 2 — v 2 )vw dx 
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and starting like in (|2.30p . we can estimate the previous identity with 

(|Wi| r + |W 2 |oo)(hi ~ V\ 2 a\v n \2* + |l£ ~ vl\v\ 2<J ) \w\ 2t7 , 

where 2er G \ 2, -j^zjj- Hence, proceeding as done to obtain (|2.34l) and (|2.35[) . 

the last quantity goes to as n — > oo and thus we can conclude that v is a 
critical point of J on i3"*(R^ +1 ). 

Finally, we now know that J'(v n )(v n — v) = [J'(v n ) — J'(v)](v n — v) — > as 
n — > oo, i.e. 

\\v n - v\\ 2 -lu (v n - vf dx - A / (v n {W * v 2 n ) - v(W * v 2 )) (v n - v) dx 

JR N JR N 

+ / [F s (x, v n ) — F s (x, v))(v n — v) dx — > as n — > oo. 

By (j2~22l) applied again with e = m, from ([2~27)) . (|234j) . (|2~35)) and (12^26)) . 

we have 

o(l) = J'{v n )(v n - v) 

> ( 1 J / l^f^n — w)| 2 da;(ia;Ar+i + m(m — oj) / (v n — v) 2 dxdxjy+ 

V TO/ ,/ K »+l JR JY + 1 

(2.36) 

where o(l) — > as n . — > oo. Since a; < to, we finally get that v n — ¥ v in 
F r 1 (M+ +1 ), as claimed. □ 

At this point, the existence of a nontrivial critical point v for J is proved 
by applying the Mountain Pass Theorem, and so the first part of Theorem 11.11 
holds true. 

Now, assume also that F(x, s) > F(x, \s\). Recall that for the critical point 
found above, the critical level (3 — J(v) is defined as 

B = inf max JH(t)), 
7erte[o,i] 

where T = {7 G C([0, 1], iJ. r 1 (K^ +1 ) : 7 (0) = 0, J( 7 (l)) < 0}. Now, the map 
t 1 y J(tv) is increasing and has a strict maximum point at t = 1; taken r > 
such that J(tv) < 0, define j(t) = tr\v\, so that 7 £ T, by the additional 
assumption on F\ moreover, the map t > J(t\v\) has a unique maximum point 
at t = 1. Thus, it is readily seen that J (try) > J (7(t)), so that 

/3 = max J(trv) > max J(7(t)) > /3. 
te[o,i] te[o,i] 

Hence, also £ h-> is a path giving the same critical level. If, by contradiction, 
\v\ were not a critical point for J, we could define a path 7 G T, obtained 
deforming 7 via the gradient flow, in such a way that max tg [ ,i] J(j(t)) < 8, 
contradicting the definition of B itself. In conclusion, also \v\ is a critical point 
for J. 
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Finally, if there exists (x, Xjv+i) € R+ +1 such that u((x,xat+i) = 0, by 
the maximum principle for the equation in R^ +1 , we get xn+i — and by 
the boundary condition we have -q^- — (x, 0) = 0, in contradiction with Hopf's 
Lemma. Hence v > and Theorem lit II is completely proved. 

Remark 2.1. In [14] the proof of the Palais-Smale condition for the related 
problem is given without using the compact embedding of [30], but exploiting 
the assumption that W(x) — ¥ as |x| — > oo, which here we do not require. 



We now give the 
Proof of Proposition \1.2\ Since ui < m, the quantity 
1 



, (\Dv\ 2 + m 2 v 2 ) dxdy — / —v 2 dx 

defines a norm ||u|| 2 in H^{R^ +1 ) which is equivalent to the usual one. Indeed, 
applying (|2.22[) with e — m, we get 

> i 1 - — ) J \Dv\ 2 dxdy + (m 2 - Lorn) J v 2 dxdy > C\\v\\ 2 

for any v € iJ r 1 (R^ +1 ). 
Now, let us set 

M ={ve i/ r 1 (R^ +1 ) : / v 2 (W * v 2 ) dx = l\= Sf- x (0), 



where &(v) = J RN v 2 (W(x) * v 2 ) dx - 1. 

It is easy to see that M is a non empty differentiable manifold of codimension 
1. Indeed, for any v G iJ r 1 (R+ +1 ) such that v{x,0) ^ 0, consider the map 
ip : [0, oo) — > R defined as 



i>(t) =t / u 2 (W*?; 2 )c2x. (2.37) 

JR" 

It is clear that ip is a strictly increasing function such that "0(0) =0 and ip(t) — >■ 
oo as i — > oo, and thus M is non empty. Moreover, if v € M and we assume 
that @'(v)(w) = 0, i.e. (using the symmetry of W) 



I (W 

we get in particular 

v 2 (W * u 2 ) dx = 0, 



a contradiction with the fact that v £ M. 
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Now, since F > 0, we immediately see that the C 1 functional I : i/^(R^ +1 ) — > 
K defined as 

= \\Hl + I F(x,v)dx 

1 JR N 

is bounded below. Let (v n ) n C M be a minimizing sequence for J on M. It 
is readily seen that (v n ) n is bounded, so that we may assume that v n — v in 

iJ r 1 (R^ +1 ), v n -> v in L^R^) for every g e ^2, and a.e. in 1^. Moreover, 

by Ekeland's Variational Principle (see for example [32l Theorem 8.5]) we can 
also assume that I'^ M (v n ) — > 0, i.e. there exists a sequence (fi n ) n in R such that 

I'(v n )(w) - /x„ / * v 2 n ) v n w dx^O (2.38) 

JR™ 

asn->oo for every w £ M, and hence for any io G iJ,^(R^ +1 ). Since u„ € M 
for any n > 1 and («„)„ is bounded, from I'(v n )(v n ) — fx n — > 0, i.e. 

F s (a;,u„,u n )da;-/x n ^-0, 

JR« 

we get that also J RN F s (x, v n ,v n ) dx — fi„ is bounded. By F%) we have 

F s (x, v n ,v n )dx <Ci \v n \ e dx + C 2 / \v n \ p dx < C 
r™ Js. N Jk n 

for some universal constant C > 0, since (u n ) n is bounded. In conclusion, also 
([J, n )n is bounded. Hence, we can suppose that there exists A € R such that 
fj, n — > A as n — > oo. Proceeding as in the proof of Lemma |2.1| we can now show 
that, up to subsequences, v n — > v in H^(R^ +1 ). Moreover, M being closed in 
7? r 1 (R+ +1 ), we get that v eM is a nontrivial minimum point of / in M. Passing 
to the limit in (|2.38j) . we get 

I'(v)(w) - A / (W * v 2 ) vw dx = 

for all w £ M - hence for all w € iJ r x (R+ +1 ) -, i.e. v solves (|1.8[) with A given 
as a Lagrange multiplier. 

If in addition 2F(x, s) < F s (x, s)s for all s £ R and a.e. x G WL N , then 



A/ (VF*w 2 )w 2 dx = /'(w)(w) = ||«||* + / F s (x,v)vdx 

JR™ 

= 2J(u) + / [F s (x, v)v- 2F(x, v)] dx > 21 (v) > 0, 



and so A > 0. □ 



Proof of Proposition 11.31 It is an application of the following multiplicity theo- 
rem based on the Krasnoselskii genus, see |31[ Theorem 5.7]: 
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Theorem 2.1. Suppose that I is an even C 1 functional on a complete sym- 
metric C ' manifold M contained in a Banach space B, and suppose that I 
satisfies (PS) and is bounded from below. Let 

^l(M.) = sup{7(i^) : K C Ai is compact and symmetric} < oo. 

Then I admits at least "f(M) pairs of critical points on Ai. 

Here "f(A) denotes the Krasnoselskii genus of a symmetric set A, defined as 
7(0) = 0, and when A ^ 0, 



j(A) 



inf{m € N : 3heC°(A, W m \ {0}) odd}, 

00 if {to e N : 3 h £ C*°(A, R™ \ {0}) odd} = 0. 



In particular 7(A) = 00 for any symmetric set containing 0; see |27] or [31] for 
an introduction to the genus and some related results and applications. 

In our case, we proceed as in the previous proof, restricting / on the sym- 
metric manifold M. Imitating the steps above, one can see that / satisfies 
the (PS) condition on M, while, applying Theorem 12.11 the existence part of 
the Proposition follows from the following Lemma, whose proof is given in the 
Appendix: 

Lemma 2.2. •y(M) = 00. 

The final statement in Proposition ll.3l is exactly as in the previous proof. □ 
We conclude this section with the 



Proof of Proposition [L41 If A < 0, it is enough to repeat the final part of the 
proof of Proposition 11.21 replacing the functional / by the functional 

= l\Hl+ ! F(x,v+)dx, 

where v + — max{w,0}, so that the minimum point solves 

j-Av + m 2 v = Q inM^ +1 , 

j_^!L_ = ljv + \(W * v 2 ) v - F s (x,v+) ont" x {0} = <9R^ +1 . 

Using v~ as test function, we find 

\l = -\[ (W*v 2 ) (v'fdx- I F s (x,v+)v-dx 



v 



= -A / (W*v 2 ) (v~) 2 dx > 0, 



so that v = v + > 0. 

If F(x, s) > F(x, \s\) one can immediately see that I(v) > /(|v|), so that \v\ 
is again a minimum point for I. 

The strong maximum principle implies v > in both cases. □ 
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3 Variational identities and proof of the non ex- 
istence results 

We start this section with the first non existence result, whose proof is very 
easy and can be obtained without additional new tools. In particular, here we 
don't need the new variational identities for the half Laplacian (see Lemma l3.4l 
and equation (II. 31) ). which will be developed below in order to prove the more 
general non existence results. 

Proof of Provosition W.W Taking v as test function in (jl.9[) . if oj < we have 
0=/ {\Dv\ 2 + m 2 v 2 )dxdx N+1 - lj / v 2 dx - A / (W*v 2 )v 2 dx 

+ / F s (x,v)vdx> / (\Dv\ 2 + m 2 v 2 ) dxdxN+i, 

and the thesis follows. If w € (0, m), applying (|2.22l) with e = m, we find 

0=/ {\Dv\ 2 + m 2 v 2 )dxdx N+1 -lj v 2 dx - X (W * v 2 ) v 2 dx 

F s (x, v)v dx 

> ( 1 ] / \Dv \ 2 dxdxN+i + (m 2 — urni) \ v 2 dxdxN+\>C ] \v\? 

\ m) J m »+i J m »+i 

for some C > 0, and again the claim is proved. □ 

Now, we show by some variational identities that the existence results of 
the previous section (in particular Theorem II. lj) are, in some sense, optimal, 
provided that F — F(s). 

Let v G i/ 1 (K+ +1 ) be a solution of (JTSJ with F = F(s). By reasoning as in 
[HI Theorem 3.2 and Proposition 3.9], we can show that 

• v G L°°(IR^ +1 ), 

• v€ L P (R N ) y P G [2,oo], 



v G C°- Q (IR^ +1 ) n W^ 9 (R N x (0, R)) for any q G [2, oo) and all R > 0, 



• ifF is of class C^QR), then i; € C 1 ' Q (R^ +1 )nC 2 (Rf +1 ) and is a classical 
solution of (lL8i 



Let us set X = (x, xat +1 ) with x — (xi,..., xn) & Moreover, define 
A R = |X g K w x [0,oo) : |X| 2 < ijj, 

S£ = jx G : \X\=R and a; w+1 > oj 
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and 



b r = [x G A R : x N+1 = oj. 



Finally, for shortness, we write Vi in place of v Xi . 

We state the following result for regular functions, like solutions of (|1.8p if F 
is of class C°' Q , with obvious generalization for Sobolev functions in iJj^ c (M^ +1 )n 
iJ 1 (K^ +1 ), since functions n this space admit traces on every manifold appear- 
ing in the calculations below. 



Lemma 3.1. For any v G C 1 ' Q (R^ +1 ) H C 2 (M^ +1 ) and for every R>0 there 
holds 



-AvX-Dv dX 



1- N 



Ar 



/ \Dv\ 2 dX + / v N+ iDv ■ xdx 
Ja r Jb R 



s+ L 



R, 



1 



— \Dv\ — —\Dv ■ X\ 



do, 



Ar 



Here g 



2 1 R' 

g(v)X ■ DvdX = -(N+ 1) / G{v)dX + Rl G(v)dx. 

Ja r Js+ 

R — > R is any continuous function and G(s) = Jq g{f) dt. 



(3.39) 



(3.40) 



Proof. Fix iG{l,...,iV+l}. Denoting by v the outward unit vector to OAr, 
we have 

pjy if x N+1 > 0, 

v{X) = \ (0,...,0,-l) if ^+1=0, 



so that 



X • v(X) = 



\X\ if Xat+i > 0, 
if xn+i — 0. 



(3.41) 



For any i,j G {1, . . . , N + 1}, by Green's formula we have 



Aj 



ViVijXj dX = - 



(v^ XjVjda-- I (vi) dX. 

dA R 1 . 



Aj 



Hence, denoting by S%j the usual Kronecker symbol, we have 



L 



vaVjXj dX 



OAr 



dA, 



ViVjXjVi da + / [SijViVj + ViV^Xj] dX 



da 



-{.VifxjVj - ViVjXjVi 



+ 



dX. 



Summing up over i, j G {1, . . . , N + 1}, by (I3.41|) . we get (I3.39|) . 
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In order to prove p.40p , observe that for any i £ {1, . . . , N + 1} we have 



g(v)viXi dX 



G(v)xiVida- / G(v)dX 



dAi 



Summing up, using (|3.41l) . we obtain (|3.4Up , 

We now focus on the 3-dimensional case, i.e. on problem ([1.6 
Lemma 3.2. If v £ L 3 (R 3 ) and (f>(x) — -X, * v 2 , then 



□ 



vcf>Dv ■ x dx 
R 



v (j>dx 



16tt 



i)h,, 



Proof. Let us note that <j>(x) £ #i 2 oc (R 3 ) n D 1 

- Ac/) = 4irv 2 in R 3 

-II - II 



\D4>\ 2 dx 

dr. 

is a solution of 



(3.42) 



(3.43) 



where D^R 3 ) = Q?(R 3 ) with ||0|| 2 = / R3 \D<j)\ 2 (see also [T5]). 

Operating as we did to prove Lemma 13.11 replacing with bn, we can 
prove that 



v<px ■ Dv dx 



v 2 x ■ D(f> dx 



bn 



v 2 (bdx + 



R 



bn 



v 2 (j)dT (3.44) 



and 



-/ Acj)x-D(j)dx = -- f \D(j)\ 2 dx+ [ 

Jb R 2 J bR Jg bR 

see also [HI Lemma 3.1]. 

On the other hand, from l[3.43[) we have 



~-\Dcp\ 2 ~-\D<}>-x\ 2 



dr, (3.45) 



An v x ■ D<fi dx 



Acj)x -D<f> dx . (3.46) 

Starting from ([3.440 . using (|3.46[) and (|3.45[) . the claim follows. □ 
Lemma 3.3. If v £ H 1 ^ 3 ), there exists a sequence R n —> oo such that 



()b n 



■n 2 



dr ->• 



o« n -> oo. 
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Proof. We follow the lines of |5]. First, let us note that on dbn n we have 
±\x ■ D4>\ 2 < ^\x\ 2 \D(j)\ 2 = R n \D4>\ 2 £ L 1 ^ 3 ). Moreover, e L 6 / 5 (R 3 ) by 
interpolation, and <fi £ £ 6 (R 3 ) by the Sobolev inequality: hence w 2 € L 1 (]R 3 ). 
Thus it is enough to prove that, if / £ L 1 (K 3 ), then there exists a sequence 
i?„ — » oo such that 

Rn I \f\dr^0. 

Jdb Rn 

Assume this is not the case, so that there exists e, i?o > such that 
R \f\dr>e for every R > R Q . 

Jdb R 

/• /* oo /> y* oo 

/ |/|dx= / dfl / \f\dr> / -dR = oo, 
Jk 3 Jo Jdb R Jrq 



Then 

oo > 

and a contradiction arises. 
Lemma 3.4. If v £ H^M 3 ), then 

i' I i — r * v A ) Dv ■ x dx 

x 



□ 



Proof. From Lemma |3.2[ applying Lemma 13.31 we find 

f v<j)Dv ■ x dx = - ^ f v 2 4>dx + -^- ( \D(j)\ 2 dx. 
On the other hand, <p being a solution in D 1 (R 3 ) of (|3.43p . we get 

/ \D<j)\ 2 dx = 4tt / v 2 <j)dx. 
Substituting, we get the claim. 



(3.47) 
□ 



We are now ready to prove the variational identity (|1.11|) for the generalized 
half Laplacian, which we believe to be quite useful in studying system (|1.6[) : 

Proof of Theorem 11.21 Multiply the first equation in (|1.6[) by X ■ Dv and inte- 
grate on An. Applying Lemma |3~T1 with g(s) = s we get 



= 



\Dv\ 2 dX 



V4D1) ■ x dx — 2m 



2\Dv\*-L\DvX\* 



da 



bn 



v 2 dX 



m 2 R 



(3.48) 



By the boundary condition in (|1.8|) we have 



v^Dv ■ x dx 



ujv + A ( * v 2 ) v - F'(v) 



v dx. 



Dv ■ x dx. 
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Operating as in the proof of Lemma 13.21 (see also [TH Lemma 3.1]), setting 
cf> — f -[jj * v 2 ^j , we can prove that 



6b 



[ujv + Xtpv — F'(v)] Dv ■ x dx 



(w + X(j))v 2 dx + 3 F(v) dx 



4/ \ D <t>?dx-lf 
16tt J bR 2 J bR 

Substituting §3~J§\i into (J33H1), we obtain 

) = -/ \Dv\ 2 dX+ f ^\Dv\ 2 - Udv ■ X\ 2 da 
Ja r Js R l 2 R J 

[ \DS 2 dx + l [ (w + \cj})v 2 dx - 3 [ F(v)dx 
16tt J bR 2 J bR J bR 

|(w + A^ 2 - A ^|D0| 2 -l\x- DcpA - RF(v) 



(3.49) 



dr. 



(3.50) 



r/r 



■2m 2 / v 2 dX + 



m 2 R 



v dx. 



As in the proof of Lemma l3~3l we can find a sequence R n — > oo such that the 
integrals over dbft n and over go to as n — > oo. In this way (|3.50[) gives 

= - / \Dv\ 2 dX - 2m 2 / v 2 dX 
-— [ \Dcj)\ 2 dx + \ ( {lu + \(t))v 2 dx - 2, ( F(v)dx. 

lOTT J R 3 2 J R 3 J R 3 

By substituting in the equation above the term J \D<f>\ 2 taken from (|3.47|) . 
we finally get (TTTTTjl . □ 

We are now ready for the 

Proof of Theorem 11.31 Since v is a solution of (11.81) , we have 

Dv\ 2 +m 2 v 2 )dX = / [wu + A^-F'(w)]wda;. (3.51) 

Now we isolate J Ri \Dv\ 2 dX in (|3.51j) and substituting in (jl.llj) . we get 

= -m 2 / v 2 dX + ^-[ v 2 dx + \\ { v 2 (j)dx 
Jr\ 2 J R3 4 J R 3 

[3F(v) ~ F'(v)v] dx. 
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Thus, if (fTT2"|) holds, we get v = 0. 

On the other hand, if we isolate L 4 v 2 dX in (|3 . 5 1 1) and we substitute in 

GUT), we get 

= / \Dv\ 2 dX-%- { v 2 dx--\ ( v 2 (j)dx 



2 7 R 3 4 
[2F'(v)v - 3F(v)] dx. 

Thus, if (|1 . 13|) holds, again we get v = 0. 

Now, if cd > and A < 0, starting from fj X . 1 1 [) . using f)2 .22[) . we have 

0<(- 1 + ^L] [ \ Dv \ 2 dX +(^-2m 2 ^ f v 2 dX 



2/y 



+ 



+ / v 2 4>d.r - 3 / Ft r ),l.r. 



Choosing /j, £ in liS - > by (|1.14|> we obtain again v = 0. If w = the 
conclusion is easier. 

The last statement needs a longer proof and the following estimate, which 
also establishes a non vanishing property for nontrivial solutions of (|1.6j) . and 
for whose proof we direct the reader to the Appendix: 

Lemma 3.5. If v £ H\R^ +1 ) solves {EHJ) with A > 0, u £ (0, m) and 

F s (x, s)s > /or every s £ M. and a.e. x £ M. N , then 



v\\ 2 < — — — A / (W*v 2 )v 2 dx (3.52) 

Tfi — U) '- •• 



and iftere exists C = C{m,uj) > smc/i £/ia£ 

N| 2 > y (3.53) 

for any nontrivial solution of (| 1 - 6[) . 

Let us start noting that for any solution v and for any p > we have 

= (HTTP + 

= (p-l) f \Dv\ 2 dX + (p-2)m 2 f v 2 dX+(l-p\io ( v 2 dx 

Jr\ Jm% \ 2 J Jr 3 (3-54) 

+ (l~ P ) A / v2< t> dx + J [pF'{v)v-3F(v)]dx. 
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Now, take any p < 3/2 and start from (|3.54[) ; applying (I2.22[) with e > 0, 
we obtain 



< 



p-l + eu[--p 



p-2 



em 



\ \Dv\ 2 dxdxjy+i 
v 2 dxdxN- 



N + l 
+ 



(3.55) 



+ (t-p)a/ v 2 <j)dx+ [ [pF'(v)v-3F(v)]dx. 
V 4 / Jk« Jr3 



By choosing e small enough, we can suppose that 



p-l + eu[--p] <p-2 



em* 



2~ P 



so that (|3.55p becomes 



< 



p-2 



2- p 



\\vf+(~- pj \ J v 2 c/)dx+J [pF'{v)v-3F(v)]dx. 



By applying ([3752]) with W(x) = l/\x\ and N = 3, we find 



< 



P-2- 



— p I > A / v 2 (j)dx 



(3.56) 



[pF'(u)v - 3F(v)] dec. 



After some calculations, we find that the coefficient of J v 2 cf> in the inequality 
above is non positive iff 



uj f 1 



3a; 



5lj 



P—\ 1 > o ■ 

m \em ) 2em 4m 4 

If e < 1/m is small enough, it is clear that both sides of the previous inequality 
are positive, so that we are allowed to choose 



p > I 6 — 5em 



3em z 



1 



4(1 - em) 



Let us remark that the function g(e) = (6 — hem — 3em 2 /w)[4(l — em)] -1 is 
strictly decreasing in (0, 1/m), and that g(0 + ) = 3/2, so that a possible choice 
on p < 3/2 is given for e < 1/m. 

Therefore, passing to the limit as p f 3/2 in (|3.56|) . we get 



uj — 3m , 

^ 'A ^ A 

4m — 4w 



v 6dx + 



r i , , , ^ us — 3m 

[F'(v)v-2F(v)]dx< 4m _ 4[ / 



v d>dx 



by assumption on F appearing in (|1.15[) . Being the remaining coefficient a 
strictly negative number, we get J v 2 cf> = 0, and from (|3.52p also v = 0. 

Theorem 11.31 is now completely proved. □ 
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We conclude with the 



Proof of Theorem 11.41 The first part is very similar to the proof of Theorem ll.3l 
which was obtained adding (v)v for p — 1 and p — 2. Now, starting 

from (|3.54j) . if (|1.16[) holds, all the coefficients are less or equal to 0, and we 
get v = 0; if (|1.17p holds, all the coefficients in (|3.54p are nonnegative, and we 
obtain again v = 0. 



Now assume the (11. 18ft holds. Since ui 6 I 0, 2m 



2p-3 



and A < 0, 



starting from (|3.54p and using (I2.22p and the fact that p > 2, we find 



> 



P-1 



Ti-P\- 



\Dv\ 2 dX- 



(p - 2)m 2 + 



v 2 dX. 



Both the coefficients of the integrals above are nonnegative provided that 

2fl-3w (p-2)m 2 



p- 1 2 

which is possible by the bound on to. 



(2p-3)w' 



□ 



A Appendix 

Proof of Lemma Y2~% Fix k € N and take any subspace H k of H^(R+ +1 ) having 
dimension k. We first prove that Mk := Mfl Hfc, which is non empty by the 
definition of the map in (|2.37[) . is bounded. Indeed, assume by contradiction that 
there exists an unbounded sequence (v n ) n in Mfe. Without loss of generality, 
we can assume that 4u£ Hk, where ||u|| = 1. 
Setting U n — v n W * v 2 , then 

/ U n v n dx = / v^W * v^dx = 1. 

JR" il" 

Dividing both sides by ||vn|| 4 , we obtain 

0= lim / ^J=lim / ^L W *-^dx= f v 2 W*v 2 dx>0 

n ^°°jR« \\ v n\\ jwoo Jr« \\V n \\ \\ v n\\ JR N 

since v is nontrivial, and we get a contradiction. 

Mk being bounded and closed in Hk , we get that Mk is a compact subset of 

Hk- 

We now show that 7(Mfe) > fc, and being k arbitrary, we deduce that 
"/(Ma) = oo, and the lemma is proved. For this, let us consider the map 
7r : S^ -1 — > M, where S k ~ 1 denotes the unit sphere of Hk, defined as tt(u) = um, 
um being the unique point of the half line R + m intersecting M; note that the 
definition of 7r is well posed by (|2.37[) . Clearly tt is an odd continuous map with 
tt^- 1 ) = M k ; thus, by [3TJ Proposition 5.4 (4°)], we get j(M k ) > 'y(S k ~ 1 ), 
while 7(S'' C ~ 1 ) = k by gU Proposition 5.2]. □ 



Pseudorelativistic Hartree equation: existence and non existence 



26 



Proof of Lemma \'6.b\ In (jl.9[) take w — v, obtaining 

\v\\ 2 = ljI v 2 dx + X (W*v 2 )v 2 dx-I F s (x,v)vdx 



<oj v 2 dx + A / (W * v 2 )v 2 dx 

by the assumption on F s . Using (|2.22p with e = m we obtain 

IMI 2 < — / \Dv\ 2 dxdx N+ i + mw I v 2 dxdxN+i+X / (W * v 2 )v 2 dx, 
m Jr«+ 1 Jr^ 1 Jrn 

from which (|3.52|) follows. 

From (|3.52p . by applying (|2.23l) . we immediately get p.53[) for any solution 
v ^ 0. □ 
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